DEGENERACY LOCI, PFAFFIANS, AND VEXILLARY 
SIGNED PERMUTATIONS IN TYPES B, C, AND D 



D. ANDERSON AND W. FULTON 

Abstract. We define a notion of vexillary signed permutation in 
types B, C, and D, corresponding to natural degeneracy loci for 
vector bundles with symmetries of those types. We show that the 
classes of these loci are given by explicit PfafRan formulas. The 
Grassmannian formulas of Kazarian are important special cases, 
and the corresponding double Schubert polynomials of Ikeda, Mi- 
halcea, and Naruse are shown to be equal to these Pfaffians. 



Introduction 

The Giambelli-Thom-Porteous formula gives a formula for the co- 
homology (or Chow) class of a locus where two general subbundles E 
and F of a given vector bundle V meet in at least a specified dimen- 
sion. Kempf and Laksov |KL] generalized this to give a determinantal 
formula for the locus where a given subbundle E meets each member 
of a flag of bundles F. = Fi C F2 C . . . C V^; their polynomials have 
since reappeared under various names like multi-Schur or generalized 
factorial Schur polynomials. Lascoux and Schiitzenberger |LS] defined 
double Schubert polynomials &u){x,y) for every permutation w, which 
have the stability property that the polynomial does not change when a 
permutation is regarded naturally in a larger symmetric group. These 
polynomials give formulas for loci where two general flags E, and F, 
meet in given dimensions ( |F2j ). Lascoux and Schiitzenberger also de- 
fined a notion of vexillary permutation, whose Schubert polynomials 
are given by generalized Schur determinants, or multi-Schur determi- 
nants: 

SA(c(l),...,c(r)) = |c(i)A,+j-,|. 

Here c{i) = l + c(i)i + 0(^)2 + . . . , with the c{i)j commutating variables. 
In |F2j these loci were shown to correspond to degeneracy loci with 
particularly simple descriptions, which are further simplified in Section 
1 of this paper. 
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Pragacz ( jPlj . |P2] ) showed that Schubert classes in Grassmannians 
of isotropic subspaces of a vector space with a nondegenerate skew- 
symmetric or symmetric form can be given by polynomials known as 
Schur Q and P-functions, which are certain universal polynomials that 
can be written as Pfaffians. Billey and Haiman [BHj gave polynomials 
(actually power series) for Schubert varieties in flag varieties of types 
B, C, and D. The rough state of knowledge in 1995, including several 
attempts at general formulas, can be found in |FPj: see |KTj . |BKTlj . 
[BKT2j and |PRj for progress since then. 

In a remarkable preprint [K] a decade ago, Kazarian gave Pfaffian for- 
mulas for those degeneracy loci that describe how one isotropic subbun- 
dle in a bundle with a skew or symmetric form meets a general flag of 
isotropic subbundles. His formulas are generalized Pfaffians, which it is 
natural to call multi-Schur Pfaffians, and denote by PfA(c(l), . . . , c(r)). 
Here A is a strict partition of length r, i.e. Ai > A2 > ■ ■ ■ > A,. > 0, 
and c{i) = 1 + c{i)i + c{i)2 + • • • , with commuting variables as before; 
in addition, one requires that the matrix with (/c, /)-entry 

A; 

i=i 

be skew-symmetric. When r is even, Pf;v(c(l), . . . , c(r)) is the Pfaffian 
of this matrix. When r is odd, 

r 

PfA(c(l), . . . , c(r)) = Y.(-lf-'c{k),, . . . cTF) . . . , c(r)). 

fc=i 

Alternatively, one can set A^+i = and use the formula in the even 
case. In particular, PfAi(c(l)) = c(1)ai, and a Pfaffian for the empty 
partition is 1. (Basic results about Pfaffians can be found in |Knj . jK] . 
and Appendix D of [FPj .) 

More recently, Ikeda, Mihalcea, and Naruse ([I], |INj . [IMN] ) have 
succeeded in defining general double Schubert polynomials for signed 
permutations of types B, C, and D, which have the same stability 
property as in type A. Their work is in the context of equivariant co- 
homology, but this is very close to the general degeneracy loci setting. 
Their work grows from that of Billey and Haiman, and the correspond- 
ing single polynomials (for ordinary cohomology) are exactly those of 
[BH] . They show that those corresponding to the longest elements in 
any of the finite Weyl groups are Pfaffians, and they show that some of 
Kazarian's formulas (for Lagrangian subbundles in type C) are special 
cases of theirs. Modified forms of multivariable versions of the Schur 
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P- and Q-functions, which had been developed by Ivanov [Ivj, play an 
important role in their work. 

In this paper we define a notion of vexillary signed permutation in 
types B, C, and D. We show that they correspond to degeneracy loci 
of a particularly simple form, and we show that the double Schubert 
polynomials for their classes are given by explicit Pfaffians. These 
include all the Pfaffians in |IMN] and [K] as special cases. 

Billey and T. K. Lam [BL] defined a notion of vexillary in types B, C, 
and D, by requiring the corresponding single Schubert polynomials of 
|BHj to be equal to the corresponding Stanley symmetric polynomial. 
Our vexillary elements form subsets of theirs, which coincide in type B. 
Billey and Lam ask if there is a class whose polynomials are Pfaffians, 
which is what we answer here, for double as well as single polynomials. 

We describe our main result in type C, which requires reviewing 
some language from [IMNj : details will appear in Section 2. A key role 
is played by the ring F, which is a quotient of a polynomial ring in 
indeterminates Qk-, with one generator and relation for each positive 
integer k: 

k 

r = z[Qi, Q2, . . . ]/{Ql + 2 Y,{-^yQk+,Qk-j. A; = 1, 2, . . . ). 

J=l 

We denote by the same Qk the image of Qk in F, with Qq = \. These 
relations say that Q -Q* = 1, where Q is the power series I + Q1 + Q2 + 
. . . , and Q* = 1 — Qi + Q2 — ■ ■ ■ ■ We can therefore substitute for Qi 
the corresponding term Ai of any power series A = 1 + Ai + A2 + . . . 
that satisfies the identity A ■ A* = 1. Q 
For k I, set 

I 

Qki = QkQi + 2 y^^{—iyQk+jQi-j- 

i=i 

The relations say that Qkk = ^ and Qki = —Qik- Hence, for any strict 
partition A = Ai > ■ • ■ > > 0, the matrix with (i, j)-entry Qx- Xj is 
skew symmetric, so we can form its Pfaffian, which is denoted by Qx] 
equivalently, Qx = Pfx{Q, ■ ■ ■ ,Q). These Qx, as A varies over all strict 
partitions, form a basis for F over Z. 

For any indeterminates ti, ^2, • • • , we write T[t] for T[ti,t2, . . .], and 
call elements of such a ring polynomials, a slight abuse of language. 

^If one takes A = Yl'^i{'i^ + Xi)/{l — Xi), as done in [IMNj . one gets an embedding 
of r in the ring of symmetric functions in the x variables, but we need speciahzations 
that are not of this form. And we use x (and y) variables for Chern classes, to 
maintain the analogy with Schubert polynomials of type A. 
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We require the multivariate version of these Qx polynomials, due to 
Ivanov [Iv], which are elements in the ring T[t]] we denote them by 
Qa or Qa(^), a departure from the notation of [Iv] or |IMNj . These 
can also be defined as Pfaffians, which is the approach we take, com- 
pleting somewhat the treatment in [Iv] and |IMN] . First define q{k) = 
Q ■ YljZii^ + tj)j regarding Q = 1 + Qi + . . . as a power series, so 
q{k)p = Qp + eiQp-i + e2Qp-2 + • • •, where Ci = ei{ti, . . . , tk-i) is the 
j^th elementary symmetric polynomial in these variables.. Set 

Qfc = q{k)k = Qk + eiQk^i + e2Qk-2 H h ek-iQi, 

Then, for nonnegative integers k and /, define 

I 

Qki = q{k)kq{l)i + 2 Y^h'^Y qik)k+M^)i-j, 
i=i 

One verifies that Qfc/c = and Qik = —Qki, so we can define the general 
Qa to be the Pfaffian of the skew-symmetric matrix whose (i, j)-entry 
is Qa, A,- Equivalently, Qa = PfA(c(l), . . . , c(r)), where c{k) = g(Afc) = 

The polynomials we will construct for vexillary signed permutations 
in type C, and all the double Schubert polynomials of type C, are 
elements in the polynomial ring T[x, y] = T[xi,X2, ■ ■ ■ ,yi,y2, ■ ■ ■] in 
two sets of variables. In the vexillary case, they can be obtained by 
substituting some of the x's and y's for some of the fs in these multi- 
Schur Pfaffians. We define these vexillary signed permutations and 
their polynomials from the notion of a triple of type C, by which we 
mean a triple r = (k, p, q) of sequences of positive integers of the same 
length s, 

k = ki < ■ ■ ■ < ks, p = Pi> ■ ■ ■ >Ps, q = qi > ■ ■ ■ > qs, 
satisfying the conditions that 

(*) {pi - Pi+i) + {qi - qi+i) > ki+i - ki 

for 1 < i < s — 1. To each triple one can write down a signed permuta- 
tion w(t), which can be defined as the w of minimal length such that, 
for each i from 1 to s, the number of a with a > Pi such that w{a) is 
a barred integer b with b > qi, is equal to ki. These are our vexillary 

^ Our polynomial Q\ is what is denoted by Q\{x\ —t) in [Iv] and [IMNj . and our 
Q\ is their Q\{x). We have eliminated the x variables, which they use to embed T 
in a ring of symmetric functions - for which we have no use - and we have changed 
the signs of the t variables, to avoid having to keep track of unnecessary signs. 
These formulas are more explicit than those given in |IMN| . see Proposition 2.6 
below. 



DEGENERACY LOCI, PFAFFIANS, VEXILLARITY 



5 



signed permutations of type C. Such a triple defines a strict partition 
A = A(t); it is the strict partition with A^. = Pi + qi — I, and minimal 
otherwise; that is, 

Afc = Afc. + ki — k, 
where ki is the minimal integer in the sequence k with k < ki. 

We define a polynomial Qt^x, y) in r[x, y] by substituting xi, . . . , Xp^-i 
and yi, . . . , yq^-i (in any order) for the first A^^ — 1 values of ti, ^2, ■ ■ • 
in Q\(t); then substitute the next Ps-i — Ps Xi's and the next g^-i — 
Qs ?/i's, in any order, and continue until the values Xi, . . . ,a;p^_i and 
yi, . . . , Vqi-i have been substituted. Equivalently, set 

Pi-i gi-i 
c{h) = Q-l[il + x,)-l[il + y,), 
3=1 i=i 

and set c{k) = c{ki), where ki is minimal greater than or equal to k. 
Then Q-rix, y) = PfA(c(l), . . . , c(fcs)), the Pfaffian of the matrix whose 
(kj) entry is c{k)xA^)\i + '^T.^Ui-^^V c{k)x,+jc{l)x,.j. 

These polynomials are used to construct the double Schubert polyno- 
mials of type C, for any element in the infinite Weyl group = IJ Wn, 
i.e., to any signed permutation w, as follows. We denot^ these poly- 
nomials, which live in r[x,?/], by <tw{x,y). If r is the triple with 
k = 12 ... n and p = q = nn — then w{t) is the element 

Wo"^ of longest length in Wn. In this case A = (2n— 1, 2n — 3, . . . , 1). 
The double Schubert polynomial {x, y) can be defined to be the 
polynomial Qi-(a;, |/). For any other w, choose n so that w is in Wn, 
and write w = wi^^ ■ Sj^ . . . Si^ where the Si are the standard generators, 
and the length of w is £ less than the length of wi^\ and then set 
€^{x,y) = di^o---o di^{€jn){x,y)). 

The key in |IMNj to making this work is showing that this polynomial 
is independent of the choice of n, which is a corollary of our theorem. 
In fact, r[x,?/] is canonically isomorphic to the graded inverse limit of 
equivariant cohomology rings of the corresponding flag varieties, as the 
rank n goes to infinity; proving this was a key step in |IMNj : it also 
follows from our theorem, since the Schubert classes form a basis for 
both rings over Z[y]. 

^The polynomial we denote by €wix, y) is corresponds to what would be called 
^w{x, —y; z) in jIMNj — although the notation they use for their variables is differ- 
ent, and they write ^w{z, t] x), so their Zi is our Xi, their ti is our —yi, and their Xi 
is the "dummy" variable that we avoid using. Similarly for *Bu,(a;, y) and D^ixjy) 
in types B and D. Our sign convention makes all the monomials appearing in all 
Schubert polynomials of types B, C, and D positive. 
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The geometric setting for the degeneracy loci is a vector bundle V of 
some even rank 2n, on a nonsingular variety X; V has a non-degenerate 
skew form, together with two flags of isotropic subbundles E = Ei D 
E2 D . . . and F = Fi D E2 D . . . , with Ei and Fi of rank n+1 — i. In 
particular, Ei and Fi are maximal isotropic (Lagrangian) subbundles. 
The degeneracy locus fir for a triple is defined by the conditions that 
the dimension of the intersection of the fibers Ep^{x) fl Fq^{x) is at 
least ki for each i from 1 to s, and every point x of X. We write this 
condition as 

dim(Ep^ nF,J > ki, l<i<s. 

The non-degenerate form on V makes V/E the dual bundle of E, 
and V/F the dual bundle of F. In particular, c{V — E — F) = 
c{V) / c{E)c{F) = c{E*)/c{F) = c{F*)/c{E). The identities defining 
r imply that we may send Q to c(y — E — F), i.e., Qi to CiiV — E — F) . 
Set 

Xi = ci{Ei/Ei^i) and = ci(Fi/Fi_i). 

Theorem 1. (1) The class of Qt is obtained by the substitution of 
c{V - E- F) for Q m Q^(x, y) . 

(2) The polynomial Qx(a^, y) is equal to the double Schubert polynomial 
€.u){x,y), where w = w{t). 

The result in (1) can be written as follows: Set 

c{h) =c{V-E-F). c{V/E,:) . ciV/Fj, 

and set c{k) = c{ki), where ki is minimal greater than or equal to k. 
Then the class of Qt is the Pfaffian Pfx{c{l), . . . , c(r)), with r = kg. In 
fact, one need not have all the bundles present in the flags: it suffices 
to have each Ep. and Eg. of the corresponding codimensions. 

When we say that a polynomial P is the class of a degeneracy locus 
Q, it should be interpreted in the following sense. When Q has the 
expected codimension (the degree of P), this is meant literally: for a 
specified scheme structure on Q, [Q] = P in the cohomology or Chow 
ring of X, where the brackets denote the cycle class of a scheme (each 
irreducible component is counted with multiplicity given by the length 
of its local ring at its generic point, as in [Fl] ). In particular, this is 
the case when the bundles are in general position. In general, one can 
start with V and F, on X, and let X — )■ X be the corresponding flag 
bundle, with tautological flag E,. The bundles E, and the pullback of 
F, are always in general position. The general case is deduced from 
this. In fact, a flag E, on X corresponds to a section s: X — )■ X, with 
s~^{E,) = E,. Each degeneracy locus f2 on X is the pullback of the 
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corresponding locus on X. Whenever the codimension of is the 
expected one, then 

s*[n] = [a\. 

This uses the fact that all these loci, in the corresponding flag bundle, 
are Cohen-Macaulay. These points are discussed in |F1] §14, where the 
refined pullback is used to construct a class s'[fl] living on Q, without 
any hypotheses of generality or codimension; in current language, this 
can be regarded as the virtual class [Q]™ of the locus. In types A and C, 
the loci get their scheme structure from the (local) vanishing of minors 
of appropriate ranks. In type B these may vanish to higher order, so 
fl must be given its reduced structure; and in type D, one must also 
take this locus to be the closure of the locus where all inequalities are 
equalities. The locus fl is always reduced and irreducible (provided X 
is connected, as we assume). One can also, more symmetrically, use 
flag bundles for both E, and F,, but this is not necessary. 

Note that this setting of a flag bundle X X contains the setting 
for equivariant cohomology, where X is (a flnite-dimensional approxi- 
mation to) the classifying space for a torus. Although the equivariant 
setting is a special case of the degeneracy locus setting, the Chern 
classes yi in that setting are algebraically independent, so that any 
formulas found in the equivariant case are sure to be the same in the 
general degeneracy locus case. 

One contribution of this paper is to make the formulas of [IMN] more 
explicit, with direct, geometric proofs. The bulk of |IMN] depends 
on localization in equivariant cohomology, together with inductions 
involving Chevalley and transition formulas. Although localization is 
available in the general setting of degeneracy loci, we do not need it 
for our main results. 

In the deflnition of a triple, it is useful to allow the strict inequali- 
ties of (*) to be replaced by weak inequalities; we call such a triple a 
redundant triple. Any redundant triple can be reduced to an ordi- 
narary triple by omitting any term ki,pi, qi for which equality holds in 
(*), and the signed permutation doesn't change by this reduction. All 
the above constructions and the theorem apply to redundant triples. 
For the degeneracy loci, this allows more inequalities on dimensions 
of intersections, although the added ones are in fact redundant. Note 
that the terms in matrices for the Pfaffians change, but, in fact, the 
resulting polynomials are identical. 

The case of Theorem 1 when all pi are equal, so one is measuring how 
one bundle Ep meets a given flag of some F^'s, is the result of Kazarian 
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[K] in type C. The loci that are vexillary include all Grassmannian 
loci for Grassmannians of maximal isotropic subspaces, but not all for 
Grassmannians of lower dimensional subspaces. (The nonvexillary loci 
involve intersections of Ep with duals of some -F^'s.) The maximal 
elements in each finite Weyl group are vexillary, and the inverse of any 
vexillary element is vexillaryjj 

The general double Schubert polynomial formula for general degener- 
acy loci in type C can be deduced from this as follows, as in |BGGj and 
[D] in the case of flag bundles, and |F2j and |F3j for degeneracy loci. 
First complete the flag F, to a complete flag, by setting F_i = (Fj+i)-*- 
for i positive. Given a signed permutation w in Wn, we have fi^,, the 
locus where the dimension of Ep (1 Eg is at least the number of a > p 
such that —w{a) > g, for p G {1, . . . , n} and q G {±1, . • . , ±n}. In 
type C, all these loci get their scheme structure by the vanishing of the 
minors that describe the rank conditions. 

Corollary. The class of Q^] is the polynomial (Ew{x,y). 

A key idea from [K] and jIMNj . to achieve stable polynomials, inde- 
pendent of the ambient dimension, is to emphasize codimensions, and 
avoid the dimension of the ambient bundle; this often forces one to 
write down the right formulas. For example, the locus where Ei meets 
El can be given by —Xi — • ■ ■ — a;„ — ?/i — ■ • ■ — which does not stabihze 
as n grows. Writing this as Ci{V — Ei — Ei) is the stable answer. 

These double Schubert polynomials satisfy analogues of the 

main properties of those in type A. In particular, they satisfy the five 
properties discussed by Fomin and Kirillov |FKj . They are (0) homo- 
geneous of degree i{w); and (1) related by the corresponding difference 
operators, so represent the corresponding Schubert loci. They (2) mul- 
tiply with the same coefficients as in the cohomology rings; and (3) 
have nonnegative coefficients when expressed in terms of monomials. 
They are (4) stable, i.e. independent of the n of the Weyl group Wn 
containing w. 

^ Our vexillary signed permutations have all their positive values occurring in 
increasing order, while those for submaximal subspaces would allow two groups of 
increasing positive values. The only nonvexillary element of that is not ruled 
out by having increasing positive values is i/; = 3 2 1. Its top term is Q32 + Qai, so 
it cannot be a Pfaffian of the kind we have been considering. Of the 48 elements in 
W3 of type C (or B), 33 are vexillary; 19 are accounted for by Kazarian (and their 
duals), with 2 more in |IMN) . Of the 24 elements in W3 of type D, 18 are vexillary, 
with 9 from [K], 2 more from |IMNj . As the size of the Weyl group grows, the ratio 
of our new formulas to the previous formulas grows rapidly, but, as in type A, the 
percentage of elements that are not vexillary increases even more rapidly. 
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In addition, they are (5) double polynomials satisfying all these 
properties in the equivariant or degeneracy setting, with (t^~i{x,y) = 
^w{y,x). To this, we can add (6) they are given by Pfaffian formulas 
for vexillary signed permutations. Note that (2) says that 

(1) '^u{x,y) ■ (Ey{x,y) = ^ c';^^(E^{x,y), 

w 

for unique polynomials c^^, in Z[y]. (By Graham's positivity result 
[G] . these coefficients are positive in the variables yi — and —2yi, 
although we are far from knowing combinatorial formulas for them.) 
The positivity (3) is a nontrivial combinatorial result that is proved in 
[IMN] . The analogous properties are satisfied in types B and D. 

This contrasts with the fact proved in [FK] that there are no poly- 
nomials satisfying properties (0), (1), (2) and (3), even for single poly- 
nomials of type B2. In that source, as in most of the early work in this 
area before Billey and Haiman [BH], a poljTiomial was taken to be in 
or in 7j[x,y] for double polynomials. Working in the ring r[a;,?/], 
so regarding the Qx as monomials, makes this success possible. 

The situation in type B is quite similar to that in type C. We denote 
the corresponding polynomials by Px, Pa(^) and Pt{x, y); as one would 
expect, they come from the Qx, Qxit) and QT{x,y) by division by 
powers of 2. 

For type D, the corresponding polynomials are considerably more 
complicated, and we denote them by Rx, ^x(t) and RT{x,y) to make 
the distinction clear. In addition, in type D, there are two polynomials 
for each strict partition, depending on whether one adds a to its end 
or not; so each strict partition occurs in type D with both an even 
and an odd length. (This corresponds to the two families of maximal 
isotropic subspaces of a vector space with a quadratic form). There is 
one striking relation among them, however: when one expresses them 
appropriately in terms of the basic polynomials, the coefficients in all 
three types agree. Namely, expand 

PA(t) = 5^P^(t)P„ QA(t) = 5^g^(t)g„ MA(t) = $^r^(t)P„ 

with coefficients p^(t), qxi^)^ ^a('^) ^M- Then ^^(t) = Pxi^), 
which is no surprise, but it is also true that 

(2) r^,{t)=p':ll]{t), 

where A(+) is obtained from A by adding 1 to each of its parts (in- 
cluding the last, which may be 0). The same relation is true for the 
corresponding polynomials for vexillary elements: writing (5t-(x, ?/) = 
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J2 Qri^j y)Qfj.i with coefficients in Z[x, y], and similarly for types B and 
D, we have q!^{x, y) = pt^i^x, y), and 

(3) r^(x,y)=p:5i)(x,y), 

where t(+) is obtained from r by adding 1 to each pi and qi of the 
triple. It is also the case that, as signed permutations, w{t(+)) = 
w{t). Our proof of this uses specialization results of |IMNj . It would 
be interesting, and could simplify the type D story significantly, if one 
could find a direct reason for these identities. 

We know three ways to prove Theorem 1, and its analogues in types 
B and D. One can assume the results of [IMNj , and then show how to 
get from one vexillary polynomial to another by difference operators - 
a result of independent interest, which will be carried out in |AF3] : this 
proves (2), and (1) follows. The general formula can also be deduced 
from Kazarian's result for maximal isotropic bundles, by a simple di- 
agonal trick: putting an appropriate skew form on © V", the locus 
where Ep meets Fg in a given dimension is the same as the locus where 
the diagonal Ay meets Ep © Eg in the same dimension. (See Section 2 
below.) The third approach, which we follow here, proves (1) directly, 
by finding loci that map birationally to the desired loci. These loci can 
be defined by vanishing of sections of vector bundles; we then apply 
Kazarian's elegant Gysin formulas to push these classes forward. This 
latter has the advantage that (2) follows, and one recovers the main 
results of [IMN] (and [K]) directly. 

We begin by reviewing type A, in a simpler language than in [F2j 
which provides a model for the other types. There are differences, 
however, between type A and the others. In type A the flags E, and 
F, play dual roles, one corresponding to codimension and the other to 
dimension, while, in types B, C, and D the two flags play interchange- 
able roles. (This explains why we have kept the sign difference in type 
A, which is in the original double Schubert polynomial notation, but 
have eliminated it in the other types.) In types B, C, and D there are 
maximal isotropic subbundles, which is the geometry behind the rings 
r and r', while type A has only the ring Z. 

Then we turn to type C, where we complete the proof of the theorem, 
and give applications to symmetric maps of vector bundles. Types B 
and D are carried out in the next two sections. The polynomials in 
type B differ from those in type C by division of some powers of 2, 
although there is some change in the geometry. In type D the formulas 
must be modified more significantly, and again Kazarian [K] indicates 
how this modification should be carried out. As the proof in type D 
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was not included in [K], we include a proof here; this involves some 
algebra, which is put in an appendix. 

We have written this paper so that it can be read for those inter- 
ested only in complex varieties, with values in cohomology rings, or for 
varieties over arbitrary fields, with values in Chow rings. To include 
characteristic 2, one needs to make the usual modification in types B 
and D, replacing a symmetric bilinear form (u, f ) by a quadratic norm 
N{v). The interested reader can find a detailed study of this modifica- 
tion in |EKM] . and we will not mention it again. 

In |AF2] we show that the vexillary elements can be characterized 
by pattern avoiding, as Lascoux and Schiitzenberger did in type A. We 
also show that there is a natural notion of essential sets for signed per- 
mutations, corresponding to which of the conditions defining the locus 
are necessary; although not obvious from this geometric description, 
this notion turns out to be precisely the notion defined by Reiner, Woo 
and Yong |RWY] for general Coxeter groups. In |AF3] we give another 
characterization of vexillary permutations in terms of labeled (shifted) 
Young diagrams, which makes it clear how to go from one vexillary 
class to another by a sequence of difference operators. In |AF4J we 
show how to extend this story to allow skew symmetric and symmetric 
forms on a vector bundle with values in a line bundle. 

All of this work is inspired by p] and |IMN] . and we are deeply 
indebted to their authors. 

1. Type A revisited; Bundles without Symmetries 

In this section we review the results in type A, from |F2] . but modi- 
fied - and simplified - to generalize to the other types. We are given a 
vector bundle V of some rank n, on a variety X, assumed nonsingular 
for simplicity, together with two flags of subbundles: 

V = EqD EiD E2D ...D Ea 

and 

= Fo C Fi C F2 C . . . C Fb, 

with the corank of Ei being i, and the rank of Fj being j. For each 
permutation w in Sn, we have the locus flu, defined by the conditions 
that 

dim {Ep nFq) > \ {i > p \ w{i) < q] \ 

for all p and q. This dimension condition describes the set of points 
X in X where the fibers Ep{x) and Fq{x) meet in at least the given 
dimension, a locus locally defined by determinants. For the flags in 
general position (as in the introduction), this locus has codimension 
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equal to the length i{w) of w, i.e., the number of pairs i < j such 
that w{i) > w{j); equivalently, in notation valid for all types, i{w) 
is the minimum number £ for which one can write w — Sj^ • . . . • Sj^. 
Note that the definition is independent of n, and makes sense whenever 
w{i) < w{i + 1) for i > a and w~^{j) < w~^{j + 1) for j > b. For i and 
j positive, set 

Xi = Ci{Ei_i/Ei) and yj = Ci{Fj/Fj_i). 

Then the class [^2^] of in the cohomology group H'^^^'^\X), in the 
complex setting, or the Chow group A^^'^\X) in general, is given by the 
double Schubert polynomial &u,{x,y) of Lascoux and Schiitzenberger: 

[n^] = ey,{x,y). 

To describe these polynomials, we use the one-line notation, writing 
w — w{l) w{2) . . . w{m) to mean that these are the first m values of 

UJ, and that w{i) = i for i > m. Let Sj be the transposition that 
interchanges i and i + and let di be the corresponding difference 
operator with respect to the x variables, i.e., 

^^if) = if - Si{f))/{xi - Xi+i); 

here Si(/) interchanges Xi and Xj+i in the polynomial /, treating y 
variables as scalars. These Schubert polynomials are determined (and 
can be calculated) by the properties that, ior w — nn — 1 . . . 2 1, the 
longest permutation in Sn, &w(yX,y) = Y[i+j<ni^i ~yj)- And, if w{i) < 
w{i + 1), then &yj{x,y) = di{&wi{x,y)), where w' — w ■ Si is the result 
of switching the entries in positions i and i + 

There is a natural way to describe degeneracy loci, by specifying a 
decreasing sequence Ep. of bundles in the E, flag, and an increasing 
sequence of bundles Fq. in the F, flag, and requiring that the corre- 
sponding bundles Ep. and Eg- meet in at least a given dimension ki. 
This idea leads directly to the notion of a vexillary permutation. Define 
a triple of type A to be a triple r = (k, p, q) of sequences of positive 
integers of the same length s, 

k ^ ki < ■ ■ ■ < kg, p = Pi > • • • > Ps, q. ^ qi < ■ ■ ■ < Qs, 

satisfying the conditions that ki < for all 1 < i < s, and 

(*) {Pi - Pi+i) + (gi+i - Qi) > ki+i - ki 

for 1 < i < s — 1, and Ps — Qs + kg > 0. Setting k = Pi — Qi + ki, these 
conditions are equivalent to requiring li < pi for all i and Zi > . . . > 
^5 > 0. The corresponding locus Qt is the locus where 

dim{Ep.nFg.) > ki. 
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for all i between 1 and s. Setting Vi = Qi — ki = Pi — k, this is the locus 
where the rank of the map from Fg. to V/Ep. is at most r^, 1 < i < s. 

This is the same as the locus fi^, where w = w{t) is the permutation 
of minimal length such that the cardinality of {j > Pi \ w{j) < qi} is 
ki for all i. To construct this permutation, start by putting the ki 
integers gi — /ci + 1, . . . gi, in this order, starting in the first position to 
the right of pi; then insert A;2 — A;i different integers, as large as possible 
but at most equal to q2, in increasing order, as far left as possible but 
to the right of position continue in this way until kg integers have 
been entered; then insert the other integers in the other positions, in 
increasing order. For example, for the triple t = (268, 742, 579), 
we construct its permutation as follows: put 4 and 5 in positions 8 and 
9; then put 2, 3, 6, and 7 in positions 5, 6, 7 and 10; then put 8 and 
9 in positions 3 and 4; and fill in the integers 1 and 10 in the first two 
positions, getting u'(t) = 1 10 8 9 2 3 6 4 5 7. The permutations 
arising in this way arc vcxillary (they avoid the pattern 2 14 3), and 
every vexillary permutation arises from a unique such triple. 

The dctcrminantal formula for this locus (or double Schubert poly- 
nomial) is particularly easy to describe in this language. A triple deter- 
mines a partition A = Ai > • • • > of length r — kg. This is defined 
by setting A^- = Pi — Qi + h, and, for general k. set A^ = Afe- with ki 
the minimal integer in the sequence k that is at least as large as k. 

Define 

Pi Qi 

<h) = \{{l + x,)/\{{l + y^), 
i=i i=i 

and, for A; < r not equal to any /cj, set a{k) = a{ki), where ki is the 
smallest in the sequence that is larger than k. Then the formula for 
this locus, which is &u){T){x,y), is the multi-Schur determinant 

(4) s;,(a(l),...,a(r)), 

which is defined to be the determinant of the r by r matrix whose 
entry is a{i)xi+j-i. 

There is a natural duality in this story. In the general setup, let 
V = V* be the dual vector bundle, and let = KeiiV* — F*), 
Fj — KeY{V* E*). Then the locus fl^ for the original setup is equal 
to the locus Qyj-i for this setup. This refiects (and reproves) the fact 
that 6ty-i(— y, —x) — 6tu(x, y). Define the dual of r to be the triple 

T* = {ls< •■• <li, Qs > ■ ■ • > qi, Ps < • ■ ■ < Pi)- 

Then w{t*) = w{t)~^. The partition for r* is the conjugate (trans- 
pose) A' of the partition for r. The corresponding Schur polynomial. 
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Sxi{a'{l), . . . , a'{r')) with r' = li, using the rows with 

Qs + l-i Ps + l-i 

a'ik) = n (1-^^)/ n (1-^^)' 

and a'{l) = a'{li) for < I < This is equal to the original Schur 
determinant, a basic identity among Schur determinants (which also 
follows from this geometry). 

There is a natural notion of redundant triple in type A, which 
allows the inequalities between the Z's to be weak: li> ■ ■ ■ >ls- These 
give the same vexillary permutations, and the same determinants, al- 
though the entries of the matrices change. (The reason is that one 
matrix can be changed to the other by a sequence of elementary row 
operations.) One can reduce a redundant triple to an ordinary triple 
by leaving out any {ki,pi, qi) for which U = /j+i. For example, the triple 

(1 234567 8, 77665432, 4567779 9) 

reduces to the above triple (2 6 8, 7 4 2, 5 7 9). The added conditions 
on dimensions of intersections follow from those of the reduced triple. 
Such redundant conditions appear often in the literature, including the 
Kempf-Laksov formulaJl In addition, it can be useful to start with an 
ordinary triple, and expand it to a redundant triple, as in this example, 
with ki = i; in this case X = I. Note that this can often be done in 
more than one way. 

Here is a proof of the formula (jlj) for the locus Qr- We may replace 
X by the bundle of flags in V, as described in the introduction, and 
assume the bundles are in general position. Consider first the case 
where qi = = i for 1 <i < s. The locus is defined first by requiring 
Fi to be contained in E^^ , which is defined by the vanishing of a section 
of Hom(Fi, Vj Ep^), so is given by the top Chern class Cp^ {F^ V"/i?pJ. 
On this locus one has the locus where the map from F2/F1 to V/Ep^ 
vanishes, given by Cp2((F2/Fi)* ® V/Ep^). Continuing in this way, one 
sees that the locus is given by the formula 

s 

l[cpm/F,^^y^v/Ep^). 

i=l 

It is an elementary calculation (cf. |F1] . App. A. 9 or |Mac] (3.6)), using 
row operations on the matrices, to see that this is equal to the Schur 
polynomial 

Sp,...pMV - Ep, - Fi), . . . , ciV - Ep^ - F,)), 

^This completes and corrects Reraark 9.16 of [F2j : note that the notion of re- 
dundancy is not preserved by the duahty that interchanges k and 1. 
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and this is the required formula in this case. 

Next consider the case where ki = i for all i, but with arbitrary. We 
construct the flag bundle Y over X of flags Di C D2 C ■ ■ ■ C Dg, with 
Di of rank i and contained in Fg- . The locus Qt on X is the birational 
image of the locus on this flag variety given by the conditions that 
Di is contained in Ep.. By the case just considered, this is given by 
the polynomial Spj...p^(c(l), . . . , c(s)), with c{i) = c(y — Ep- — Di). To 
conclude in this case, we need a Gysin formula to push this forward by 
the projection 71: Y ^ X. This formula, due to [JLPj . and given in 
this form in [Flj . Cor. 14.2, is 

Mspi...Psic{V - Ep, - A), ...,c{V-Ep^- Ds))) = 

sx,...xMV - Ep, - F,J, ...,c{V-Ep^- FJ), 

where Aj = pi — qi + i. This is the required formula in this case. 
The general case is reduced to the preceding case by inserting integers 
between successive ki and /cj+i, and corresponding integers between pi 
and pi+i and between qi and g^+i, to get a redundant triple with ki = i 
for all i. 

Standard arguments, by passing to a flag bundle over X (see |F2j). 
show that the formula is valid if one only has the bundles Eg, C Eg^ C 
. . . and Ep, D Ep^ D . . . of V. 

Note that the proof of this formula includes a proof that the double 
Schubert polynomials of vexillary permutations are given by the corre- 
sponding determinants - a result proved in [Mac] with a fair amount 
of algebra. It also implies that construction of general double Schubert 
polynomials is independent of the choice of n used in their definition. 

2. Type C, Symplectic Bundles 

We begin with two algebraic lemmas, which can be found in a geo- 
metric context in [K]. The fact that the matrices whose Pfaffians are 
the Q\ is skew-symmetric is a special case of the following lemma. 

Lemma 2.1. Let Xi,...Xr be positive integers. For 1 < k < r let 

S{k) be a set of positive integers of cardinality strictly less than A^. Set 
q{k) = Q ■ Y[jes{k)(^ + ^i)- Then the matrix whose {k, I) entry is 

A; 

is skew symmetric. 

Proof Since Q • Q* = 1, it follows that q{k) ■ q{l)* = UjeS{k)i^ + ^i) ' 
Y[j&s{i)(^~^j)- '^^^^ ^ polynomial of degree strictly less than A^ + A/. 
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The assertion that its term of degree + A; vanishes is equivalent to 
the assertion of the lemma. □ 

We next show that the polynomial Qt-(x, ?/) defined in the introduc- 
tion from a redundant triple is the same as that of the actual triple 
obtained from it by omitting the redundant terms. 

Lemma 2.2. Let r = (k, p, q) be a redundant triple, and let t' he the 

(possibly redundant) triple obtained from it by omitting a term ki,Pi,qi 
for which pi - pi+i + Qi - qt+i = h+i - h. Then Q-r(x, y) = Qr'{x, y)- 

Proof. For this it is useful, as in pKj, to note that Pfaffians 

Pf,„„,,(c(l),...,c(r)) 

can be defined by the same formulas for an arbitrary sequence Ai, . . . , A^ 
of integers; this Pfaffian is skew-symmetric in these indices, and van- 
ishes when two are equal. The lemma follows from the multi-linearity 
of the Pfaffians, together with the fact that they vanish whenever two 
indices are equal. In fact, one verifies that if c{k) = c{k + 1) = ■ ■ ■ = 
c{k + m), and Aj = Aj+i -|- 1 for k < i < k + m, then the Pfaffian 
PfAi...A^(c(l), . . . , c(r)) does not change if c{k) is multiplied by a poly- 
nomial rijlill + ^j) (cf- [K]' proof of Thm. 1.1). □ 

We describe in more detail how a triple r = (k, p, q) determines 
a signed permutation w{t), written in one-line notation. We want w 
minimal with #{a > pi \ w{a) = b,b > qi} = ki. Start by inserting a 
sequence of ki consecutive barred integers, gi -|- fci — 1 to gT, in posi- 
tions pi to pi — ki + 1. Then insert k2 — ki barred elements, bars of the 
smallest remaining integers that are at least q2, placed in order (bars 
of decreasing sequences, or increasing if one regards barred integers as 
negative) at or to the right of position p2 but as close as possible to 
that position. Continue in this way until one has entered kg barred 
integers. Conclude by inserting the remaining positive integers (that 
haven't been entered in barred form), in increasing order, in the re- 
maining spots. For example, consider the triple r with k = 2 3 5 8, 
p = 8 6 6 2, and q = 6 5 2 2. One puts 7 and 6 in positions 8 and 
9, then 5 in position 6, then 3 and 2 in positions 7 and 10, then 9, 8, 
and 4 in positions 2, 3, and 4; finally put 1 and 10 in the remaining 
positions 1 and 5, arriving at w{t) = 1984 10 5376 2. 

One can reconstruct the triple from the vexillary signed permuta- 
tion. To start, pi is the position after the last descent; starting at that 
position one finds a sequence of ki consecutive barred integers, ending 
in One repeats this on the remaining, but regarding elements as 
being in sequence if the only integers missing have already been taken 
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account of. The combinatorics of this correspondence will be worked 
out in detail in |AF2j . 

We turn next to the direct proof of Theorem 1. The proof follows 
the lines in type A, but using a Gysin formula of Kazarian's. We use 
the same flag bundle, with tautological flags Di C • • • C Dg, with 
Di of rank i and Di C Fg-. We have a sequence of projective bundles 
Xs Xi X, where X^ is the corresponding flag bundle with s 

replaced by k. Using the standard convention of not changing notation 
for puUback bundles, the projection tt^ : X^ — )■ Xfc_i is the projective 
bundle F{Fg^/ D^-i), with its tautological line bundle Dk/D^-i. On X^ 
we have the locus where Dj. is contained in Ep^. The locus Zg maps 
birationally onto the locus Q-r, so our goal is to compute the push- 
forward of its class [Zs]. This is done in stages. We let (pk'. Zk ^ Zk-i 
be the map induced by Hk, and set ip: — )■ X to be their composite. 

On Xi, Zi is given by the vanishing of a section of Hom(Di, V/EpJ; 
so [Zi] = Cn+pT^-i{Dl (g) V/Ep-^^). On the restriction X2\zi, we have 
Di C Ep-^ C Ep^ C D^. The locus Z2 is given by the vanishing 
of a section of llom[D2/ Di, / Ep^); so [Z2] = Cn+p2~2 

{{D2/D^y ® 

D^/Ep^). Continuing, on Xk\zk-i we have Dk-i C Ep^_^ C Ep^ C 
D^_^, and the locus Zk where Dk is contained in Ep^, is given by the 
formula [Zk] = Cn+p,-k{{Dkl Dk-i)* ® Di_J Ep^). (See [F3] and [FP] 
for a discussion of why these equations cut out these loci with their 
reduced strictures.) 

We need a Gysin formula to push forward these Chern classes. Kazar- 
ian has proved such a formula in [K], in the special case where all Ep- 
are equal, but exactly the same argument works in our more general 
setting. Let hi = —Ci{Di/ Di^i), and set 

cik) = ciV - Ep, -Fj = ciV-E-F). c{E/Ep,) ■ c(F/F,J 

the assertion is that, for any nonnegative integers mi, . . . , m^, 

(5) ^*(/^r K') = PfA.+.„„...A.+^.(c(l), . . . C{S)). 

Taking all rrii = gives the asserted formula of the theorem. This 
assertion is based on the following lemma. Fix k between 1 and s, and 
set 

H^'^ = c{Dk-, - DU) = n \^ = nV - + 2h] -2h] + ...). 

3=1 ' j=i 
Lemma 2.3. For any nonnegative integer m, 

j=0 
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A key to this is to write, on Xk, 
K ■ [Zk] = K ■ c„+p,-fc((Dfc/Dfc-i)* ® Dtr/Ep,) 

= Cn+p^-k+m{Dk^i - Dl_^ + V - Ep^ - Fq^^ + FgjDk). 

All terms in the last equation except the last are puUbacks from 
Zk-i, and the last is the tautological quotient bundle from the projec- 
tive bundle Xk — )■ Xk^i- The standard Gysin formula for projective 
bundles, this one of relative dimension n + qk — k, implies that 

i'fk)*{hZ) = Cn+p^-k+m-(n+l-qk-k){Dk-l " + V - Ep^- FqJ 

= CAfc+m(-Dfc-l - Dk-1 + V - Ep^~ Eqk)- 

With this, the proof of (1) is reduced to some formal algebra, which is 
given in Appendix C of [K]. It also follows from Proposition lA. 31 below, 
by removing the powers of 1/2, setting the u^s to 0, the g{kys to 1, 
and d{k) = c{k). (In this special case, the formula and its proof are 
exactly the same as in [K].) 

As indicated in the introduction, it is also possible to deduce the 
theorem from Kazarian's result for Lagrangian subbundles. For this, 
set V = V ®V , and put a bilinear form on V by the formula 

( (m, v), (m', v') ) = {u, u') - {v, v'), 

where the right side uses the given bilinear form on V. This is skew- 
symmetric and non degenerate, and the diagonal Ay is a Lagrangian 
subbundle, as is © F. The locus where Ay meets each Ep. © Eg. in 
dimension at least ki is the same as the locus where each Ep. meets Fq- 
in dimension at least k^. Note also that 

ciV © V)/ciAy)ciEp^ © FgJ = c(\/)/c(E,Jc(F,J, 

from which the Theorem follows. Note that this geometry reflects 
the fact that the polynomial Qri^jV) is obtained from the polynomial 
Qa(t)(^) by appropriate substitutions. 

Although not needed for our theorems, we include here the proof 
that our polynomials Qa agree with those of |IMNj . up to sign. 

Proposition 2.4. For any strict partition X, the polynomial Qx is 
equal to the polynomial denoted Q\{x\ — t) in |IMNj . 

Proof. This is true by definition (see [IMN] Remark 4.4) when A has 
length 1. When A has length greater than 2, both are equal to the same 
Pfafiian of a matrix whose entries are those of length 2 (see [IMN] . §9). 
So it suffices to prove that Q^ki = Qki{x\ —t) for any A; > / > 0. This can 
be done by the method of Ivanov [Iv], as follows. Since the Q\{x\ — t) 
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form a basis for T over Z[t], we may write Q^; = J2^\Q>yi.^\ ~ t), the 
sum over strict partitions A of length at most k+l, with a\ homogeneous 
of degree A; + / — |A| in Z[t]. Since the top terms of both are Qki, we 
know that a^i = 1. We use the fact ( |IMNj Proposition 4.2) that for 
any strict partition u of length r, Qx{—t^j^, —t^^, . . . , —tu^, 0, . . . | — t) 
vanishes if A ^ z/, and does not vanish if A = i^. If the assertion is 
false, there is a coefficient a\ that is not zero, with |A| minimal and less 
than k + l. Evaluating with u = X would give a nonzero result. The 
following lemma shows that this is impossible. □ 

Lemma 2.5. For any strict partition u = ui > ■ ■ ■ > Uj. > with 
Vi < k or V2 < ^, the specialization Q h-> ni=i(-'^ ~ t^^)/{l + t^-) sends 

Qki too. 

Proof. This is an elementary calculation. For example, if z/i < k, then 
c{k) maps to the product of all (1 ± tj), for j < k, with the sign 
negative if j is equal to some Ui and positive otherwise. Since this is 
a polynomial of degree less than k, all c{k)k+j = for j > 0, so Qui 
maps to 0. The calculation when i/i > A; > / > z/2 is a slightly longer 
but elementary exercise. □ 

To complete the discussion of double Schubert polynomials in type 
C, one needs to make the Weyl group and difference operators act 
on the ring r[x, y], compatibly with the actions on flag bundles. We 
describe the actions for the x variables, with those for the y variables 
obtained by interchanging x's and y's. The operators Sj and di are 
the same as in type A for i > 1, with Si fixing the Q^'s as well as 
the ?/'s. The operator sq takes xi to — xi, and fixes the other Xj's, 
but it takes Qt to Qk + '^Yl^j=i^iQk-j- Equivalently, sq takes Q to 
(1 + Xi)/{1 — a;i) ■ Q, which is compatible with the specialization to 
c{E*)/c{F) = Utii^-^i)KF) ^ {l + x,)Ul,il-Xj)/c{F) = 
(l + a;i)/(l — Xi) ■c{E*)/c{F). The difference operator do is defined by 
doif) = if - So{f)) /{-2xi); in particular, do{Qk) = Ej=i ^^I'^Qfe-j- 
(See [BHj and [IMNj for more about these actions.) 

As an application, generalizing results of [K] and [LP] , let ii^ be a 
vector bundle, with a flag of subbundles E = Ei D E2 D . . . , with Ep 
of corank p — 1 in E. Let F be a subbundle of E, of corank m. Let 
ip: F ^ E* he a. symmetric map of vector bundles, which means that 
the induced composition F ^ E* F* is equal to its dual. Given 
sequences of positive integers ki < ■ ■ ■ < kg and pi > ■ ■ ■ > Ps, with 
Pi — Pi+i > fci+i — ki, we have the locus where the kernel Kei^ip) meets 
Ep- in dimension at least /c,. Deflne A to be the minimal strict partition 
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with Afc- = pi + m. Let c{ki) = c{E* - F) ■ c{E/Ep-), set c{k) = c{ki) 
for ki > k minimal in general, and let r = kg. 

Corollary. The class of the locus where Ker(y9) meets Bp. in dimension 
at least ki is the Pfaffian PfA(c(l), . . . , c(r)). 

The proof is by setting V = E(BE*, with its standard skew-symmetric 
form: ( (e, a), (e', a') ) = a{e') — a'{e). Then E = EQ)0 is a. Lagrangian 
subbundle of V. Let Eg be the graph of ip, with q = m + 1. Then Eg 
is isotropic with rank(Fg) = lankE + 1 — g. The locus where Eg meets 
Ep. in dimension at least ki is the required locus. The formula is a 
special case of the main theorem, taking qi = q for all i. 

As a special case, the locus where the kernel of (f meets a given Ep 
in dimension at least k is given by PfA(c, . . . , c), where X = {p + m + 
k — 1, . . . ,p + m) and c = c{E* — E). In particular, the locus where 
a symmetric map E ^ E* drops rank by at least k is given by the 
polynomial Pf(fc,...,i)(c, . . . , c), with c = c{E* — E). 

3. Type B, Orthogonal Bundles of Odd Ranks 
The polynomials in types B and D are based on the ring 

k-l 

r = Z[Pi, P2, . . . +2 Y,i-iyPk+jPk-M-^fP2k, A; = 1, 2, . . . ). 

i=i 

One can identify Pk with \Qk, so V becomes a subring of F'; but note 
that Pq and Qq are both 1, so P = 1 + Pi + . . . . With this identification, 
for each strict partition A, one can set P\ = 2~^Qx, where r is the length 
of A. Equivalently, Pu = PkPi + 2 EJ^'i Pk+jPi-j + {-lYPk+i, and P^ 
is the Pfaffian of the matrix with (i,j)-entry Pa^a • 

There are three different bases for the ring T'[t], each parametrized 
by strict partitions, one for type B and two for type D. We describe 
here the one for type B, which we denote by Pa 3 These can be defined 
by the formula Pa = 2~''Qa, with r the length of A. Equivalently, 
setting b{k) = p{\k), where p{k) = P ■ Yl'jZii^ + ^j)? we have Pa = 

PfA(6(l), •••,%))• 

Triples are defined exactly as in type C. For a triple r, set b{ki) = 

P ■ UfJii^ + Xj) ■ n'Li'(l + and set b{k) = b{ki), where ki is 
minimal greater than or equal to k. Then PT{x,y) is defined to be 
the Pfaffian PfA(6(l), . . . , b{ks)). As in type C, these can be defined by 
substituting the x's and y's for the t's in Pa, in the same orders. The 



''In the notation of [IMNj . these would be written PA(a;|0, —t). 
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definition of the signed permutation w{t) of a triple is defined by the 
same prescription as in type C. 

Exactly as in type C, these polynomials can be used to define all the 
double Schubert polynomials 05^ of type B, starting from the polyno- 
mial for wi"^ being Pt-(x, y), where r is the triple with k = 12 ... n 
and p = q = nn — 1...1. The only difference is that the difference 
operator do is defined by the formula do{f) = (/ — so(/))/(— xi). 

The geometric setting for type B is a vector bundle V of odd rank 
2n + 1, together with a nondegenerate symmetric bilinear form on V 
(here with values in the trivial line bundle). We assume V comes with 
two fiags of isotropic subbundles, E = Ei D E2 D . . . , and F = Fi D 
F2 D . . . , with Ei and Fi having ranks n+l—i, as in type C. Degeneracy 
loci Qt are also defined as in type C, requiring dim{Ep^ fl FgJ > ki, for 
the corresponding triple. For general signed permutations w, one needs 
to add the bundles F_i := F^^^ for i > 0; then is the locus where the 
dimension of EpCiFg is at least the number of a < p such that —w{a) > 
q, for p G {1, . . . ,n} and q G {±1, . . . , ±n}. There is one important 
difference, however. In this situation, even when the bundles are in 
general position, the determinants that locally specify rank conditions 
do not cut out these degeneracy loci with their reduced structures; in 
fact, the factors of 2 that occur come from the multiplicities with which 
they occur. We refer to [F3] and [FP] for a discussion of these points. 
We will continue to write loci by these inequalities, but they need to be 
understood to be the reduced subschemes defined by the corresponding 
equations. 

We define Eq to be E-^, and E_i = E:^^ for i > 1. The bilinear 
form determines an isomorphism of V/Eq with the dual E* of E, and 
V/Fq = F*. From the filtration Ei G Eq G V we have an isomorphism 
^2n+i^ = ® E,/E^ ® A"(^/^o), implying that A'"^' ^ = 

Eo/Ei] since the same is true for F,, we have an isomorphism Eq/ Ei = 
Fq/Fi. This implies that 

c{V - Eo - F,) = c{V - E^ - Fo), 

and it is to this that Q will specialize. To specialize P, we need the 
basic fact, based on Edidin and Graham [EGj, that these Chern classes 
Ciiy — Eq — Fl) are canonically divisible by 2, for i > 0. In |EGj 
classes are produced so that 2ai = Ci{E) — Ci{F), for 1 < i < n. 
Then c{V - Eq - Fi) = c{E*)/c{F) = {c{F*) + 2 Er=i(-l)'«i)Mi^)- 
It therefore suffices to note that, for any bundle F, c{F*)/c{F) has all 
terms of positive degree canonically divisible by 2, which follows from 
the identity (1 — + = 1 — 2yi + 2yf + . . . . (To see that there 
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is a canonical division by 2 of these classes, one can also, as in [F3j . 
reduce to the situation where there is no 2-torsion.) 

We can therefore specialize the to these classes, which we denote 
for simphcity by ^CkiV — Eq — Fi). Set Xi = ci{Ei/Ei^i) and yi = 

Theorem 2. (1) The class of Qt is obtained from Pt-(x, ?/) by this 
substitution. 

(2) The polynomial Pr{x,y) is equal to the double Schubert polynomial 
^w{x,y), where w = w{t). 

Note that, for any signed permutation w, 53^ = 2~'''('")C^, where 
r{w) is the number of barred values in its one-line notation. As in type 
C, the polynomial 53^ is the class of the locus VL^i for flags of bundles 
in general position. 

The proof is almost identical to that in type C. As before, the prob- 
lem is reduced to the case where k = 1 . . . r. The same construction 
leads to bundles with loci defined by the vanishing of sections of 
bundles. The only difference is that these sections vanish doubly along 
the loci Zk- This leads to the factors of 2"'', since there are r such 
bundles. 

The proof using the diagonal trick must be modified from type C, 
as V ®V would take us from type B to type D. To do this, one uses 
a splitting principle to get to the situation where V = U ® M where 
f/ is a bundle of rank 2n — 1 with a symmetric form, and M is a line 
bundle whose symmetric form is given by an isomorphism of M®'^ with 
the trivial bundle. Then E and F are subbundles of U . One then takes 
V = U ®U ®M, with pairing ( {u,v,z), {u',v',z') ) = {u,u') - {v,v') + 
{z, z'). Then Au © and E (B F (BO are maximal isotropic subbundles, 
and one proceeds as before. Note also that the Chern class formulas 
agree, since 

c{V')/c{Au © M)c{E © F) = c{V)/c{E © M)c(F) = c{V)/c{Eo)c{F). 

4. Type D, Orthogonal Bundles of Even Ranks 

Type D differs from type B geometrically because of the existence of 
two families of isotropic subspaces of a vector space with a nondegen- 
erate symmetric bilinear form. In order to treat both families, there 
will be "even" and "odd" polynomials. To describe them uniformly, 
we introduce the notion of a partition of type D, by which we mean 
sequence 

A = Ai > A2 > ■ ■ ■ > > 



DEGENERACY LOCI, PFAFFIANS, VEXILLARITY 



23 



The length of A is defined to be r. Each partition of type D determines 
a strict partition, which is itself if is positive, and (Ai, A2, . . . , A^-i) if 
Xr = 0. Each strict partition comes from two partitions of type D, one 
of even length, and one of odd length. For example (4, 2, 1, 0) has even 
length, (4, 2, 1) has odd, both with underlying strict partition (4, 2, 1). 
We write Qx and Px for the elements in F and F' determined by the 
underlying strict partition of a partition A of type D. 

We will define a type D polynomial Ma = ^\{t) in F'[t] for each 
partition A of type D. Those for A of even length, as well as those for A 
of odd length, will form a basis for F'[t] over Z[t]. Those of even length 
will be equal to the polynomials appearing in |IMNj . although our 
description is different. Let e{k) = Y[i=ii^~^'^i) — l + + - ■ ■ + e{k)k, 
so e{k)i is the i^'^ elementary symmetric polynomial in ti, . . . Let 
r{k) = Q ■ e{k). Define 

= ^{r{k)k + e{k)k) = Pk + e{k)iPk-i + ■ ■ ■ + e{k)k, 

and define 

1 ' 
Mfc, = - ((r(fc)fc - e{k)u){r{l)i + e{l)i) + 2 Y^[-iyr{k)u+f{l)i^j) 

i=i 

= (Pfc + e(A:)iPfc_i + ■ ■ ■ + e{k)k-iPi){Pi + e{l\Pi_^ + ■■■ + e(l)i) 

I 

+ ^{-iy{Pk+j + ■■■ + e{k)kPj)i2Pi^, + 2e(0iPi-j-i + ■ ■ ■ + e(0/ 
i=i 

These polynomials are in T'[t], and the matrix M.ki is skew-symmetric: 
I^fcfc = and Mfci + ]R;fc = 0. This follows from the equation 

5^(-iyr(A;),+,r(/),_, = e{k),e{l)i , 

which follows from the fact that r{k) ■ r{l)* = e{k) ■ e{l)*. 

Note thatMfco = |(r(A;)fc-e(A;)fc) = Pk + e{k)iPk-i + ■ ■ ■ + e{k)k-iPi, 
which is not equal to M^. Note also that Mq = 1 (as is the polynomial 
for the empty partition). 

From this skew-commutativity, we can define Ma to be the Pfaffian of 
the matrix whose {i, j) entry is Ma^ a^ • When r is odd, this is interpreted 
as before: 

r 

(6) ^a = $^(-1)^-^Ma,M,^_5^_,^. 
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Note that one cannot, as in types B and C, reduce the odd case to 
the even case by adjoining a to the partition, as we have seen that 

The leading term of Ma is Px, which imphes that both the polyno- 
mials for A of even length and those of odd length form a basis of T'[t] 
over Z[t]. 

These polynomials, for r even, agree with those in pIN] : this means 
that our is equal to their Px{x\ — t) (where the subscript A to the 
P refers to the underlying strict partition). The proof is similar to 
that of Proposition 2.4; one must show that for v as in Lemma 2.5, the 
specialization Q i— )■ HLil^ + sends 4]Rfci to 0; this too 

is an elementary calculation. 

The proof of the formula (2) in the introduction, comparing the 
expansion of Ma and that of Qa(+), where A(+) = (Ai + 1, . . . , A^ + 1), 
also follows from these specialization techniques, by verifying that both 
expansions vanish by the same specializations. 

As in type C, these polynomials are unchanged if e(Aj) is replaced 
by e(Aj_|_i), whenever Aj = Aj+i + 1. In particular, they are symmetric 
in the variables tj and t^+i if j is not one of the integers Aj for which 
Aj > Aj+i + 1 or j = r (i.e. j is not a row number of a corner of the 
skew diagram of A, allowing the last row of this diagram to have an 
empty corner). 

More generally, for A a partition of type we define a multi- 
Schur Pfaffian, denoted Vi\{c{l)\d{l), . . . ,c{r)\d{r) ) as follows. The 
elements c{i) are polynomials of degree at most Aj, with constant term 
1, and each c{i) is required to divide d{i) as well as all c(j) for j < i. 
Furthermore, they satisfy d{i)d{j)* = c{i) c{j)* for all i < j. The 
Pfaffian is defined from the same matrix used to define Ma, with d{k) 
replacing r(Afc) and c(fc) replacing e(Afc), and the factors of 1/2 and 
1/4 are removed. 

Note that, unlike the situations in types B and C, one must specify 
both the d{i) and the c{i), and not just the former, to form this Pfaffian. 
When all the polynomials c{i) have degree strictly less than Aj, though, 
this reduces to Pfx{d{l), . . . , d{r)). 

A triple r = (k, p, q) of type D consists of three sequences of 
integers of the same length s, with the fc's still required to be positive, 
but the p's and g's allowing zeros: 

k = < ki < ■ ■ ■ < k^, p = Pi > ■ ■ ■ > Ps >0, q = qi > ■ ■ ■ > Qs >0, 
satisfying the same conditions that 



(*) {pi - Pi+i) + {qi - qi+i) > ki+i - ki 
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for 1 < i < s — 1. We set r = kg- A triple r of type D determines a 
partition A = A(t) of type D and length r, defined to be the minimal 
strict partition with 

Afei = Pi + Qi- 

Note that this allows to be 0, when Ps = <ls = 0. 

The signed permutation w{T)oi a triple r is the w of minimal length 
such that the number of a > pi with w{a) = h and b > Qi. It can be 
constructed by a similar prescription as in type C, but using positions 
and barred values strictly greater rather than weakly greater. Alter- 
natively, to a triple r of type D, one can construct a triple t{-\-) of 
type C or B, by replacing each pi by pj + 1 and replacing each qi by 
Qi + 1. Each triple of type C arises uniquely in this way. As signed 
permutations, w{t{-\-)) = w{t). The partitions are different, however: 
X{t{+)) = A(r)(+). The signed permutations arising this way are the 
vexillary signed permutations of type D. One gets the same signed per- 
mutations as in types B and C, but note that, in addition to those in 
the usual Weyl group, consisting of signed permutations with an even 
number of barred values, we also get those in the coset consisting of 
those with an odd number. 

As in type C, one can allow redundant triples, with the strict inequal- 
ities in (*) replace by weak inequalities; the fact that the polynomials 
don't change when one reduces a redundant triple to a triple is valid 
for these polynomials, for essentially the same reason (see Lemma 2.2). 
As in type C, any triple can be extended to a redundant triple with 
k = 1 2 ■■■ r. 

The polynomial IlT{x,y) in r'[a;,i/] determined by a triple r of type 
D can be defined by substitution from M.x(^T){t), as in type C. One sub- 
stitutes (in any order) xi, . . . , Xp^,yi, . . . ,yq^ for ti, . . . ,tx^, and then 
substitutes x^^+i, . . . , Xp^.^, . . . , yq^_^ for t^.+i, • • • , ^a.-i, continu- 
ing the substitution in groups (and using the symmetry of the polyno- 
mials Ma(^))- Equivalently, 

(7) R^x, y) = ^ Pf,(.)( c(l)M(l), . . . , c(r)M(r) ), 

where c{ki) = Yl%ii^ + ^j) ' 11^=1(1 + ^i^) — ^i^i) minimal 
with ki > k, and d{k) — Q • c{k) for all k. 

The geometric setting for degeneracy loci in type D is the following. 
We have a vector bundle V of rank 2n, with a nondegenerate symmetric 
form, and flags V ^ Eq ^ Ei ^ ■ ■ ■ and D Fq D Fi D • • • of isotropic 
subbundles. Here rkEi — rkFi — n — i. Set E — Eq and F — Fq. The 
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specialization will take Q to 

c{y ~E-F) = c{E*)/c{F) = c{F*)/c{E). 

In type D, Pj will map to ^CiiV — E — F). 

For i = 1, . . . ,n, set Xi = ci{Ei^i/ Ei) and yi = ci{Ei_i/Ei). Note 
that d{XkJ maps to c{V - Ep^ - PgJ- 

Recall that in type D there are two families of maximal isotropic bun- 
dles, depending on the dimension of intersection of E and F, which is 
constant modulo 2 on connected components. We assume for simplicity 
that X is connected. To choose a component, the convention we use, 
which is compatible with stability, is to require that the dimension of 
E n F he even when the specified integer r is even, and odd when r is 
odd. Note that this does not depend on the rank n of E and F, so it 
is compatible with stability. (Note, however, that E and F will be in 
the same family in the conventional sense when r and n have the same 
parity, and in opposite families otherwise.) 

The locus Qt for a triple can be described by requiring that the 
dimension of the intersection Ep^ fl Eg. be at least fcj for all i, but now, 
in addition to taking care that the determinants do not cut out the 
reduced loci, one must also take this locus to be the closure of the 
reduced locus where all the intersections have the asserted dimension. 
(See [ F3] and |FP] for a discussion of this.) 

The double Schubert polynomials D^, for any signed permutation 
w, are constructed by the same procedure as in types C and B, but 
with the following differences. There are two top classes for a given n. 
One comes from the triple 

T = (1 2 . . . n-1 ... 2 1, n-1 ... 2 1), 

with A(t) = (2n — 2, . . . , 2), and w{t) = 1 2 . . .n. The other comes 
from the triple 

r = (1 2 ... n, n-1... 2 1 0, ... 2 1 0), 

with A(t) = (2n — 2, . . . , 2, 0), and w{t) = 12 ■ ■ ■ n. So one has the 
top polynomials 25^(x) for these vexillary signed permutations. 

The other polynomials are defined from these by sequences of dif- 
ference operators, as before. The s, and di for i > are the same 
as in types A, C, and B. The new generator of the Weyl group is s^, 
which can be identified with SqSiSo in type C or B. This acts on T'[x, y] 
by taking xi to — X2, X2 to —xi, and leaving the other x's and all y's 
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unchanged. One calculates that, setting Vj = J2a+b= j ^1^2^ 

Si(Pfc) = Pk + 2(xi + X2) Vj-iPk-j^ + (Xi + X2)Vk-l. 

The difference operator is di{f) = (/ — Si{f))/{—xi — X2), and one has 

k-i 

i=i 

Theorem 3. (1) The class of Q-r is HT{x,y). 

(2) The polynomial Ht^XjH) is equal to the double Schubert polynomial 
'Dw{x,y), where w = w{t). 

The proof of the theorem is similar in spirit to the proofs in types C 
and B, but we need to work with quadric bundles instead of projective 
bundles. As before, we may assume k = 1 2 ■ ■ ■ r. We resolve the 
locus f^T- C X by a sequence of maps 

Zjy. r Zj^_\ 7 ' ' ' — T Zj\ r v\ , 

where each is a locus in a quadric bundle over To start, 

inside the quadric bundle Q(^) over X, we have Zi = P(-E'pJ nP(F^J. 
Letting be the tautological bundle on Q(l^) restricted to Zi, we 
have the quadric bundle Q(-Df/-Di) on Z\. Then = ¥{Ep,^/Di) fl 
f{EqjDi) C Q{Di/Di), and D2/D1 is the tautological bundle of 
Q{D^/Di) restricted to Z2, and so on. 

As before, the composed map (p: — )■ X is birational onto ^2,-, so to 
prove the theorem, we need to show that V5*(l) is equal to the Pfaffian 
Rt-(x, y). This is done inductively, as in type C (and in [K]), factoring 
V?* as ■ ■ ■ (v^r)*- 

The key step in the calculation is this. For 1 < A; < r, let /ifc = 
-ci{Dk/Dk-i), and = c{Dk-i - Dl_,), so 

c{D,_^-Dl_,) = n ^ = li{l-2h,+2h^-. ..) = +. . . . 

i=l * i=l 

For the induction, it is necessary to compute the value (ipk)* on an 
arbitrary monomial in hi, . . . , h^. It suffices to do this for powers of 
hk, using the type D analogue of Lemma [2731 
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Lemma. For 1 < k < r, and for m > 0, we have 

\j>0 

where dmfi is the Kronecker delta. 

The case = 1 is a direct calculation on the quadric bundle Q{V), 
using the presentation of Edidin and Graham [EGj . (Since H^^^ = 1, 
the formulas are much simpler in this case.) For A; > 1, it is the same, 
but one replaces V with D^_^/ D^^i, etc. 

The formula in part (1) of Theorem [3] is a consequence of the Lemma 
together with the algebraic identities proved in the Appendix. Indeed, 
the Pfaffian formula for UtIx,!/) is precisely what appears in Propo- 
sition |A]3] after substituting c{k) for g{k). (The ring A that appears 
there is the co homology ring of X, and the ring Ak, or more precisely 
its finite-dimensional quotient, is the part of the cohomology ring of 
that is generated over A by the Chern classes hi, . . . , hk.) 

The diagonal trick to reduce the theorem to the case of maximal 
isotropics is almost the same as in type C, using V = V (BV, with the 
symmetric bilinear form ( {u,v), {u',v') ) = {u,u') — {v,v'). Again the 
diagonal Ay and E ® F are isotropic, and the argument concludes as 
in type C. 

As the type C theorem applies to symmetric maps of vector bundles, 
the type D theorem applies to skew-symmetric maps. For this, let E 
be a vector bundle of rank n, with a flag of subbundles E = Eq D Ei D 
. . . , with Ep of corank p in E. Let F be a subbundle of E, of corank q, 
and let : F ^ E* he a skew-symmetric map of vector bundles, which 
means that the induced composition F ^ E* ^ F* is equal to minus 
its dual. (In characteristic 2 one should also require that (f{f){f) = 
for all / in F.) Given sequences of positive integers ki < ■ ■ ■ < kg and 
nonnegative integers pi > ■ ■ ■ > Ps, with pi — pj+i > fcj+i — ki, we have 
the locus where the kernel Ker(y9) meets Ep- in dimension at least ki. 
We assume that r = fc^ is congruent to n modulo 2; when q = 0, this 
can always be achieved by adding or removing a at the end of the 
string of p^'s. Define A to be the minimal strict partition (of type D) 
with Afc- = Pi + q. Let c(fcj) = c{E/F) ■ c{E/Ep-), set c{k) = c{ki) for 
ki > k minimal in general, and let d{k) = c{E* — E) ■ c{k). 

Corollary. The class of the locus where KeT{(f) meets Ep. in dimension 
at least ki is given by ^ PfA( c{l)\d{l), . . . , c{l)\d{r) ). 
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The proof is by setting V = E (B E*, with its standard symmetric 
form: ( (e, a), (e', a') ) = a(e') + a'{e). Then E = E Q)0 is a.n isotropic 
subbundle of V, as is the graph Eg of (f. Note that if Eq is a maximal 
isotropic subbundle containing Eg, then the dimension of Eq fl Eq has 
the same parity as n, and hence r. The formula is a special case of the 
main theorem, taking Qi = q for all i. 

Again one has the special cases where s = 1 and where q = 0, which 
recover the formulas of pK] . 

Appendix on Pfaffian Algebra 

The goal of this appendix is to prove a formula for the composition of 
certain homomorphisms of power series rings, stated in Proposition I A. 31 
below. The setting is purely algebraic, and the answer is a Pfaffian. 

More details on Pfaffians can be found in |FPl Appendix D] or [KnJ; 
here we recall only the facts we need. For a skew-symmetric r x r matrix 
M, let Mfc be the submatrix with the kth row and column removed, 
and let M^^i be the submatrix with the kth and Zth rows and columns 
removed. When r is even, the Pfaffian Pf(M) satisfies a Laplace-type 
expansion "along the Ith column," 

l-l r 
fe=l k=l+l 

which defines the Pfaffian inductively. (Note that the expansions along 
the first and rth columns have slightly simpler formulas.) For odd r, 
given a definition for m^, we use the convention 

r 

(A.l) Pf (M) = J2{-l f-^m, Pf (M,). 

fc=i 

This is equivalent to augmenting the matrix M with a 0th column and 
0th row, setting mo,A; = —'^o,k = 'mk, and taking the Pfaffian of this 
augmented matrix. The notation is slightly abusive, but the matrices 
we consider will always come with definitions for both mk,i and rrik- 

The first general formula we prove is an identity of operators on rings 
of Laurent series. In order to state it precisely, we first describe the 
ingredients. Fix r > 0, and a partition A of type D and length r. Also 
fix a base ring A (assumed to be commutative, with unit). Consider the 
ring of formal Laurent series in variables hi, . . . ,hr with coefficients in 
A; let B be the result of adjoining polynomials in variables ui, . . . ,Ur 
to this ring. For any subset K C [r] := {!,..., r}, let Ck ^ B he 
the subring where for i & K, the variables hi appear with nonnegative 
exponents. Finally, for 1 < A; < r, let -B^ = Ct^k-i] be the subring 
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involving only nonnegative powers of the variables hi, ... , h^-i. Note 
that B = Bi. 

For any subsets J ^ K C [r], we have an A[M]-algebra endomorphism 
(j of Ck, defined by (j{hi) = if i E J, and Cj(^i) = hi ii i ^ J. Since 
O is defined compatibly for Ck' ^ Ck whenever J O K O K' , we can 
safely suppress its dependence on K in the notation. When Ji and J2 
are disjoint subsets of K, we have CjiCj2 = CJ2CJ1 = 0iuj2- Finally, we 
often write Q for (^{j}. 

The function 



fihj] 



1 - hi/hj 



1 + hi/hj ' 

considered an element of C[r]^-^i,j}, is skew-symmetric in i and j. We 
set /[fc] = 1. For an index set / C [r], let M be the matrix with rows 
and columns indexed by /, with m^j = f[i,j] and = f[k] = 1, and 
let /[/] be the corresponding Pfaffian, with the interpretation of (1A.1I) 
when the cardinality of / is odd. As shown in [K] Appendix C, the 
function / satisfies the identity 

(A.2) /[/]= n 

{»<i}e(0 

For our fixed partition A, we define operators f[i,j] : C'jjj} — ^ B and 
f[k]: C^.y^Bhj 

f[t,j] = hf'hff[t,j] + hf'ufQ - uf'h^Q - uf^ufC[t,j] 

and 

m = + 

where C[h3] is defined to be when i < j and — C{i,j} when i > j. 
This makes the operators f{i,j] skew-symmetric in i and j. When 
i < j, we have 

(A.3) f[t,j] = (h^^ - v^Xi}{h^' + u^'Q) + 2 

fe>0 

When i,j,k,l are distinct, the product f[i,j]f[k,l] = f[k,l]f[i,j] is 
an operator from C^ij^k,i} to B. In particular, when \K\ is even, 
for any decomposition K into disjoint pairs {ip < jp}, the product 

/[^i; ii] /[^25 ^2] ■ ■ ■ is an operator Ck B. Similarly, when li^l is 
odd, a decomposition into such pairs together with a remainder {k} 
yields an operator f[k] f[ii,ji] /[«2, ^2] ■ ■ ■ from Ck to B. This implies 
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that the Pfaffian of a matrix with rows and columns indexed by K, 
and with entries j], is well-defined as an operator Ck — >■ B. 

For a subset of indices / = {ii, . . . , Zp} C [r], write = h\l^ ■ ■ ■ h^J" ^ 

and similarly define = u'^^^ ■ ■ ■ u^'^ . 

Finally, we define notation for signs. Given a subset K = {ki < 
■ ■ ■ < ks} C [r], the parity of an element k = ki is defined to be the 
parity of i. For k & K, set 



e{k,K) 



1 if is an even element of K; 
—1 if A; is an odd element of K, 



and, for a subset J K, define a sign 

Sgn{K, J) = (_iy-^l l^'l(_l)#(odd elements of J)_ 

We will need some identities satisfied by these signs. 

Lemma A.l. Set s = \K\, and consider a subset J = {ji < ■ ■ ■ < 
Jt} C K. 

(1) We have sgn(K, J) = (-l)L'^/2Jsgn(K, K \ J). 

(2) If s = \K\ is odd, then we have 

-e(jp, K) sgn{K \ j^, J \ j^) = {-ly-hgniK, J), 
and therefore 

sgn{K,J) if \J\ is odd; 



K) sgn{K \ j, J \ j) = < 
jeJ [ 

The key algebraic identity is this: 



'if \J\ 'is even. 



Proposition A. 2. Fix K C [r]. Fori,j,k G K, set rriij = f[i,j] 
and nik = f[k]. Let M be the corresponding skew- symmetric matrix 
with rows and columns indexed by K . We have an identity of operators 
Ck^B 

(A.4) Pf(M)= sgn{K,J)h'u' f[I]Cj: 

IUJ=K 

using (]A.1|) to interpret the left-hand side when \K\ is odd. 

Proof. The proof is by induction on s = \K\. First suppose s is odd. 
The LHS is 

p=i 
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and by induction, we know the formula for Pi{Mkp). For I L\ J = K, 

the coefficient of h^u'-'(j in this expression is 

(A.5) 

J2 K) sgn(ir \ 2, J)f[I ^i\ + Y, K) sgn{K \ j, J \ j)f[I]. 

We need to show that this is equal to sgn(_R', J) /[/], the corresponding 
coefficient on the RHS. 

When |/| is odd, so \J\ is even, the second sum in flA.Sp is zero. To 
see that first sum is equal to sgn(i^', J) /[/], by the previous lemma we 
have sgn{K \ J) = (— l)'^*^-'^)/^sgn(i^' \ i, / \ z), so 



(-l)(-^)/2sgn(ir, /) Y^(-l)P-^f[I X t,] = sgn{K, J)f[I]. 
p=i 

When |/| is even, so \J\ is odd, the second of these sums is equal to 
sgn(i^', J) /[/]. We claim that the first sum is zero in this case. To see 
this, expand f[I\i] and write the sum as 

\i\ fp-i \i\ 

p=l \ q=l q=p+l 

where the sign in front is (— l)*^*~^)/^sgn(K, /). For each fixed p, the 
summand is /[/], by the Laplace expansion. Since there are |/| sum- 
mands of alternating sign, the sum is zero. 

When s is even, use the Laplace expansion to write the LHS of 
(IA.4P as a sum of size s — 2 Pfaffians. Then use induction and compare 
coefficients as in the odd case. □ 



An algebraic pushforward. For each k, set Ak = A[[hi, . . . , hk]]. We 
will consider algebraic "pushforward" homomorphisms (v^fc)* : Ak — )■ 
Ak_i. The main formula computes the composition of these in terms 
of a certain multi-Schur Pfaffian. 

We describe the Pfaffian first. Fix a partition A of type D and length 
r. Assume that the base ring A is graded, and for each 1 < k < r, 
suppose we are given series of (commuting) elements d{k) = l + d{k)i + 
d{k)2 + --- and g{k) = 1 + g{k)i + g{k)2 + ■■■ ■ The g{k) are required to 
be finite, with g{k)m = for m > A^, and each c{i) divides d{i), as well 
as g{j) for j > i. Furthermore, the d^s and g's are required to satisfy 
the relations d{k)d{l)* = g{k)g{l)*, where d{l)* = l-d{l)i + d{l)2 . 
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The multi-Schur Pfaffian we need is defined along the fines of Section 
4 in tfie text. Form an r x r matrix M witfi 

A; 

and set = d{k)x^ + g{k)x^,. Tfie relations on d and g guarantee tfiat 
M is skew-symmetric, and we write Pf\{g{l)\d{l), . . . ,g{r)\d{r) ), for 
its Pfaffian, using (lA.ip to interpret tfiis wfien r is odd. 

Tfie fiomomorpfiisms (ifk)* are A^.i-linear, and are defined bjH 



\i>o 



2 



wfiere H^''^ = Utl — 



Proposition A. 3. Given a partition A of type D and homomorphisms 
{(Pk)* as above, we have 

(A.6) ■ ■ ■ i^rUl) = ^ PfA( 9{IM1), . . . , g{rMr) ). 

To prove tfie proposition, recall tfie rings Br G ■ ■ ■ G Bi = B (of 
Laurent series in h and polynomials in u). Define an Afc_i-linear fio- 
momorpfiism@ pk : Bk — )■ A^-i by 

Pfe(/ir ■ ■ ■ ■ ■ ■ O = d{k)m, ■ ■ ■ rf(r)„„(7(l)„, ■ ■ ■ g{r)n^. 

Using p and (, tfie fiomomorpfiism (pk)* can be rewritten as 



\i>o 



- + hi/hk 
'1=1 ' 




Tfiat is, after applying p^, tfie fiomomorpfiism {pk)* becomes multipli- 
cation by tfie operator ^k := (1/2) (/i^ Jit/ TTvfe + (-l)''"^^fc'Cfc 



'^If the elements d{k)m are zero for all sufficiently large m — say, for m > N — 
then the same formulas define maps A^./! ^fc_i//^fc_i, where / is the ideal 

generated by all monomials in h of degree A''. We only point this out in case one 
prefers to work with finite-dimensional extensions of A, such as the those that 
appear as cohomology rings in the geometric setting. 

^As with the homomorphisms (tpk)*, when the elements d{k)m are zero for all 
sufficiently large m, the same formula defines a map pj, : Bk/I Bk — > Ak-i/I Ak-i- 
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Using linearity, the composition {ipk-i)*{ipk)* acts by sending h'^_^K^ 

to 

Pk-i {^k-i K-iPk{^k K)) = pk-i , 

and similarly, the composition (v^i)* ■ ■ ■ {^Pr)* multiplies /i™^ ■ ■ ■ /i™'' by 
the product of these operators, pi $i • ■ ■ $r- This product expands as 

using sgn([r], J) = (— l)^^^^-? I J^-'l. The operator inside the paren- 
theses in this expression is exactly the RHS of the identity (]A.4p of 
Proposition IA.2t using the identity (1A.2P to substitute /[/]. 



(A.7) 



Recall the matrix M used to define the right-hand side of (1A.6I) . By 
construction, we have = and by (lA.Sp . we have = 

Pi{f[hj])- Linearity of pi combined with Proposition IA.2I (using the 
case K = [r]) proves the identity flA.6p . □ 
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